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(54) Improvements in or relating to image sensing devices 

(57) An image sensing device includes: a light sens- 
ing element 20 for providing a signal in response to inci- 
dent light; a comparator 24 coupled to the photo 
sensing element 20 for detecting when the signal 
reaches a reference level V REF ; a resetting device 22 
coupled to the light sensing element 20 for resetting the 
light sensing element 20 when the signal reaches the 
reference level V REF ; and a memory device 26 coupled 
to the comparator 24 for receiving and storing an output 
from the comparator 24. 
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Description 

FIELD OF THE INVENTION 

[0001 ] This invention generally relates to image sens- s 
ing devices, and more particularly it relates to image 
sensing devices with a frequency modulated output 
exhibiting a randomly delayed phase. 

BACKGROUND OF THE INVENTION 10 

[0002] In a typical prior art image sensor, light gener- 
ated carriers are integrated for a predetermined fixed 
. integration time. After the integration is completed, 
charge is converted to voltage and read out. Voltage is 
can be read out in each pixel directly by an x-y scanner 
or by a single charge detector, common to the whole 
array, if a CCD charge transferring principle is 
employed. The output signal from such devices is 
always an analog voltage proportional to the product of 20 
light intensity and integration time. 
[0003] There are several disadvantages to the stand- 
ard prior art approach. The analog signal level is small 
in the areas of low illumination and high in the areas of 
high illumination. The charge detector thus must have a 25 
high dynamic range and a high linearity over this range. 
A very low noise floor is also required to detect low level 
signals. Another disadvantage is the possibility for a 
flicker caused by the beat between the illuminating 
source frequency (fluorescent lighting) and the frame 30 
scanning frequency determined by the integration 
period. Many problems also arise when the analog sig- 
nal needs to be converted to its digital equivalent. Com- 
plicated signal conditioning circuits such as CDS and 
AGC amplifiers need to be used to interface between 35 
the sensor and the A/D converter. This is power con- 
suming, costly, and potentially distorts the signal if not 
properly implemented. 

SUMMARY OF THE INVENTION 40 

[0004] Generally, and in one form of the invention, an 
image sensing device is provided that comprises: a light 
sensing element for providing a signal in response to 
incident light; a comparator coupled to the photo sens- 45 
ing element for detecting when the signal reaches a ref- 
erence level; a resetting device coupled to the light 
sensing element for resetting the light sensing element 
when the signal reaches the reference level; and a 
memory device coupled to the comparator for receiving so 
and storing a digital output from the comparator. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0005] The present invention will now be further ss 
described, by way of example, with reference to the 
accompanying drawings in which: 



FIG. 1 is a preferred embodiment general pixel con- 
cept; 

FIG. 2 is an array architecture incorporating the 
pixel concept of FIG. 1 ; 

FIG. 3 is a pixel circuit which implements the gen- 
eral pixel concept in FIG 1 ; 
FIG. 4 is a semiconductor device cross section of 
the circuit of FIG. 3; 

FIG. 5 is a timing diagram describing the operation 
of the device of FIG. 3; 

FIG. 6 is a modification of the architecture of FIG. 2 
with only one comparator and one memory element 
for each column in the array; 
FIG. 7 is a pixel circuit for the architecture of FIG. 6; 
FIG. 8 is a comparator, latch, and scanner stage for 
a column of the array of FIG. 6. 

[0006] Corresponding numerals and symbols in the 
different figures refer to corresponding parts unless oth- 
erwise indicated. 

DETAILED DESCRIPTION OF PREFERRED EMBOD- 
IMENTS 

[0007] The preferred embodiment is an improved 
image sensing concept with a digital output that elimi- 
nates many drawbacks of the prior art Charge is con- 
verted into a digital signal directly at the photosite or as 
close to it as possible. The conversion is accomplished 
at a predetermined fixed level well above the noise floor 
which eliminates the conversion nonlinearrties and 
improves the dynamic range. The integration time for 
each photosite differs according to illumination level, so 
that there is no global integration period possibly caus- 
ing an image flicker. 

[0008] A preferred embodiment general pixel concept 
is shown in Figure 1. The device of Figure 1 includes 
photosensing element (light sensing element) 20, reset 
switch 22, capacitor C 0 , comparator 24, n-bit memory 
cell 26, multiplex (MUX) switch 28, and 36, source volt- 
age Vdd, reference voltage V ref , clock signal <|> c , memory 
control signal <|>cm. common node (ground) 30, word line 
(output) 32, and bit line (Y-address) 34. The capacitor 
C 0 represents the charge integration and storage com- 
ponent of the photosensing element 20. The preferred 
embodiment in Figure 1 is a photosensing element 
which can be reset by feedback from a comparator and 
provide a digital output to a memory element that is cou- 
pled to a multiplexer for readout and reset at a later 
unspecified time (hence a delayed phase frequency 
modulation). The light sensing element can be any type 
of a photo diode including buried or pinned architec- 
tures. The light sensing element can also be a CCD 
(charge coupled device) structure with at least one 
stage or only a portion of a stage such as a CCD photo- 
gate. 

[0009] The operation of the device of Figure i is sim- 
ilar to a single-slope analog to digital (A/D) converter, 
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one of the simplest methods of analog to digital conver- 
sions. It also resembles a Delta Sigma A/D concept 
where the Delta element is replaced by a reset. The 
operation is as follows. Input current is integrated on a 
capacitor. When the voltage on the capacitor reaches a 
threshold, the capacitor is reset and the time to reset is 
measured. In some cases it is easier to count the 
number of resets in a given larger interval of time rather 
than to measure the time interval length of a single cycle 
itself. This method is preferred in the present descrip- 
tion. 

[001 0J The typical image sensor pixel is almost an 
ideal integrator, the current source is represented by 
the photon generated current. Therefore, this A/D con- 
verter concept is suitable to be used for in-pixel A/D 
conversion. The device of Figure 1 provides a technique 
for extracting the digital signal from many pixels in a typ- 
ical image sensor array. 

[0011] The operation of the device of Figure 1 pro- 
ceeds as follows. As light is sensed, the photo sensing 
element 20 produces current which discharges capaci- 
tor C c . When the voltage on the sense node 36 reaches 
the reference voltage V refl the capacitor C D is reset by 
reset switch 22 and a digital "one" is stored in memory 
26. The reference voltage V ref can be globally and 
dynamically controlled in each pixel or fixed. After reset 
the cycle is repeated. 

[0012] The memory element 26 utilized in each pixel 
allows time for pixel addressing and readout. Since 
many pixels are present in the array, the readout time is 
not negligible. Moreover, the instant of the readout can 
not be in sync with each photosite reset. The phase 
delay of the digital output is thus random in general and 
does not carry any useful information. The length of the 
readout time of course depends on the array architec- 
ture. 

[001 3] An example array architecture is shown in Fig- 
ure 2. The architecture of Figure 2 includes image sen- 
sor array 40 which includes image pixels 42-57. Y- 
address 59-62, and word lines 64-67; Y-decoder 70; Y- 
address input node 72; horizontal data latch 74; hori- 
zontal scanner 76; horizontal scan clock signal b HS ; and 
data output node 78. The image pixels 42-57 contain 
the device shown in Figure 1. The Y-address input, 
which is either in serial or parallel fashion, is used to 
select one of the horizontal lines 59-62 in the image 
sensor array 40. When one of the horizontal lines 59-62 
is selected, all the n-bit memory cells in that line are 
addressed and output to the horizontal data latch 74 
through the word (column) lines 64-67. Then the data is , 
transferred to output node 78 by the horizontal scanner 
(shift register) 76. While the data is scanned by the hor- 
izontal scanner 76, another one of the horizontal lines 
59-62 can be addressed. The horizontal data latch 74 
allows for Y-addressing and readout simultaneously. 
[0014] The output from the sensor is a series of bits 
U ei o or one) depending on the data which was stored in 
the n-bit pixel memory 26. When the memory data is 
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addressed and clocked out, the memory is also reset. 
The data from the line latch 74 can be scanned out from 
the sensor either in a serial fashion or in a mixed paral- 
lel/serial organization. It is easily seen for example that 
the columns of the vertical word lines 64-67 can be" 
grouped by eight and scanned in parallel. This is not a 
problem for digital systems. Any grouping can be 
accomplished. 

[001 5] An important element of the pixel shown in Fig- 
ure 1, in addition to the memory 26. is the comparator 
24. A simple comparator circuit such as a dynamic com- 
parator used in DRAMs can be used in the device of 
Figure 1 because it is fast and consumes little power. 
The comparing function is "ON" only when the clock sig- 
nal * c is "ON\ Since the discrete intervals of the clock 
signal are finite, a small error in the frequency modula- 
tion results. This error, however, is balanced by a large 
power savings because the comparator is "OFF" most 
of the time. The accuracy can be increased by increas- 
ing the frequency of comparator clock signal 4> c . Many 
schemes are possible. Global frequency control and 
dynamic frequency control for each pixel, or block fre- 
quency control can be used. 

[0016] Another important element of the pixel is the 
MUX switch 28. shown in Figure 1. This is a standard 
circuit which transfers data to the column word lines 64- 
67. It can also accomplish the memory reset if the mem- 
ory is simple and stores only a single bit of data. For a 
multiple bit memory 26, the data is clocked out to word 
lines 64-67 by memory control signal <fr cm . Memory con- 
trol switch 36 is "ON" when MUX switch 28 is "ON". 
[001 7] An example pixel circuit which implements the 
general pixel concept in Figure 1 is shown in Figure 3 
The pixel circuit of Figure 3 includes photo transistor 82 
transistors 84-88, capacitor 90, diode 92, bit line (Y- 
address) 34, column sense line (word line) 32, source 
voltage V dd , clock signal <fc. and common node 
(ground) 94. An example semiconductor device cross 
section of the circuit of Figure 3 is shown in Figure 4. 
The device of Figure 4 includes P type layer 100; tran- 
sistor 87 which includes gate 102 and N+ regions 104 
and 106; phototransistor 82 which includes N region 
108 and P+ regions 110 and 112; transistor 84 which 
includes gate 113, N region 108, and N+ region 118; 
transistor 86 which includes P+ region 114, N region 
1 16, and N+ regions 1 18 and 120; transistor 85 which 
includes gate 122 and N+ regions 120 and 124; diode 
92 which includes P+ region 126 and N region 128; 
MUX transistor 88 which includes gate 130 and N+ 
regions 132 and 134; capacitor 90; clock signal fc, 
source voltage V^. ground node (common node) 136, 
gate oxide 138, field oxide 140. word line 32, and bit line 
34. The transistor, diode, and capacitor reference num- 
bers are from Figure 3. The circuit of Figure 3 is only an 
example, the general pixel concept of Figure 1 can be 
inplemented by many other circuit configurations. The 
capacitor 90 represents only a single bit memory in this 
case. 
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[0018] The operation of the circuit ol Figure 3 is 
described below. After transistor 85 resets phototransis- 
tor 82 and the gate of transistor 84, the photo generated 
carriers cause holes to be injected from the emitter of 
photo transistor 82. This hole current charges the gate 
of transistor 84. As soon as the potential of the gate of 
transistor 84 crosses the threshold (internal transistor 
reference voltage in this case), transistor 84 turns "ON". 
This increases the base current of photo transistor 82 
and, through a regenerative process, both transistor 84 
and photo transistor 82 are turned hard "ON". When 
transistor 84 and photo transistor 82 are turned "ON", 
diode 92 charges capacitor 90 to a "high" state. When 
clock signal <t> c is turned "ON" (high) at the same time 
that transistor 84 is "ON", transistor 85 is turned "ON" 
and the gate of transistor 84 is reset. Since the capaci- 
tance of node 83 is small compared to the load capaci- 
tance of trainsistor 84, node 83 is discharged faster than 
both transistor 84 and phototransistor 82 are turned 
"OFF". This resets the photosite. When clock signal 4> c 
is turned "ON" and transistor 84 is "OFF", transistor 85 
remains "OFF and the integration continues. When 
capacitor 90 is addressed by MUX transistor 88, it is dis- 
charged. 

[0019] The operation of the device of Figure 3 is 
described in further detail by the timing diagrams shown 
in Figure 5. The photosite signal 150 represents the 
voltage at node 83 in Figure 3. As charge integrates in 
phototransistor 82, the voltage at node 83 rises as 
shown in Figure 5. When the voltage at node 83 
reaches the threshold voltage V REF transistor 84 turns 
"ON". This charges capacitor 90 (memory element), as 
shown by the memory pulses 4»mem. On the next pulse 
of the clock signal <f» c after transistor 84 turns "ON", the 
voltage at node 83 is reset by transistor 85. Clock signal 
6 C is not shown in Figure 5. <|> c is substantially faster than 
bit line signal 4>mux* 

[0020] The voltage on capacitor 90 is then readout on 
the next pulse of the bit line signal <(>mux* Capacitor 90 is 
discharged during readout. The output signal <|> out is 
then a series of pulses, as shown in Figure 5 with their 
phase in general randomly delayed with respect to 
reset. The frequency of the pulses in output signal <fr out 
is proportional to the intensity of the light impinging on 
the phototransistor 82 with the phase not carrying any 
useful information. The frequency period to intensity is 
mapped linearly in discrete increments determined by 
the frequency of photosite clock signal $ c . The output 
signal $ ouX can be processed by simple filtering ctf more 
sophisticated digital decimation such as that used in 
delta-sigma analog-to-digital converters. 
[0021] For small arrays, the general pixel concept of 
Figure 1 and architecture of Figure 2 can be modified 
such that a single comparator and memory element can 
be used for all the pixels in a column of the array, as 
shown in Figure 6. The architecture of Figure 6 includes 
image sensor array 160 which includes image pixels 
162-173, Y-address lines 175-178, and word lines 180- 



182; Y-decoder 184; Y-address input node 186; compa- 
rators 188-190; horizontal data latch 194; horizontal 
scanner (shift register) 196; horizontal scan clock signal 
4> HS ; and data output node 192. The word lines 180-182 

5 also serve as the reset lines: — - — 

[0022] For the device of Figure 6, the addressing time 
is short This allows for a single memory element in 
latch 194 and a single comparator 188-190 for each col- 
umn. The function of the sensor of Figure 6 is essen- 

10 tially the same as the sensor of Figure 2. The signal is 
output on the word lines 180-182 and compared with a 
threshold (reference voltage) by the comparators 188- 
190. When the threshold is crossed, a logic "one" is 
loaded into latch 194. The next line is addressed while 

is the latch 194 is scanned out by scanner 196. When the 
threshold is crossed the corresponding photosite is 
reset as in the system in Figure 2. 
[0023] An example pixel circuit for the image pixels 
162-173 of Figure 6 is shown in Figure 7. The pixel cir- 

20 cuit of Figure 7 includes NMOS transistors 210-213; 
photodiode 215 (light sensing device); image sensor 
bias voltage V DDi ; Y-address line 216; current load 218; 
common node 220; and word line (output and reset) 
222. Reset is accomplished when there is a "high" sig- 

25 nal on both Y-address line 216 and word line 222. This 
resets the photodiode 18 to the V DDi bias. 
[0024] An example of the comparator, latch, and scan- 
ner (shift register) for a column of the small array of Fig- 
ure 6 is shown in Figure 8. The circuit of Figure 8 

30 includes NMOS transistors 230-236, PMOS transistors 
238-245. resistor 247, shift register stage (scanner 
stage) 249, source voltage V dd , reference voltage V RER 
column sense line 250, latch stage transfer pulse fa, 
comparator control signals <|>cpi and <|>cp2. sh' ft register 

35 load pulse 4>r S . and shift register clocks <|>sri and 4> SR2 . 
Transistors 230, 231, 232, 238, and 239 form compara- 
tor 252. Transistors 234, 235, 241, and 242 form mem- 
ory 254. Line 260 is coupled to the previous shift 
register stage (not shown). Line 262 is coupled to the 

40 next shift register stage (not shown). This circuit 
requires a photocell such as the one shown in Figure 7 
which has a single common line for sensing and reset. 
[0025] The operation of the circuit of Figure 8 is 
described below. As the signal 4>cpi is turned "ON" 

45 (low), the comparator 252 compares voltages on the 
sense line 250 and the V REF line. When the sense line 
output fails below reference voltage V REF (when the 
photosite has integrated sufficient charge), the compa- 
rator 252 will latch to a "low" output state. This state is 

so loaded into memory 254 by transfer pulse <|> LT . After this 
cycle, comparator control signals <fr C pi and 4>cp2 are 
switched high to return the comparator 252 to its original 
state. The memory stage 254 then stores the "low" state 
of the comparator output. Then the shift register load 

55 pulse 4> RS is briefly turned "ON". This causes the "low" 
state of memory 254 to be loaded into the shift register 
stage 249. At the same time, both P-channel transistors 
243 and 244 are "ON". This turns the reset line (sense 
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line) 250 high. In the case when memory 254 is storing 
a "high" state, transistor 243 is off and the column reset 
line 250 will not be reset (not be turned high). 
[0026] In the next step, the serial shift register 196 is 
scanned out to clock all the column data out of the sen- s 
sor. At the same time, the photocell array address (Y 
address) is changed to select another line for readout. 
[0027] The advantage of the architecture of Figure 6 
is less complexity in the pixel. The pixel can be 
designed smaller. Also power consumption is smaller w 
since there are fewer comparators. 
[0028] The architectures of Figures 2 and 6 can easily 
be modified to include more than one horizontal shift 
register in the array. Several registers can be operated 
in parallel to arrange the grouping of the data into a 75 
serial/parallel configuration in order to increase the rea- 
dout speed. The number of parallel lines can be 
selected such that speed and power consumption are 
optimized. 

[0029] While this invention has been described with 
reference to illustrative embodiments, this description is 
not intended to be construed in a limiting sense. Various 
modifications and combinations of the illustrative 
embodiments, as well as other embodiments of the 
invention, will be apparent to persons skilled in the art 25 
upon reference to the description. For example, other 
memory (latch) configurations and comparator circuits 
can be used. 
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memory device comprises a single bit memory. 

6. The device of any of Claims 1 to 4, wherein the 
memory device comprises a capacitor. 

7. An image sensing device comprising: 

an array of image sensing pixels having rows 
and columns; 

a plurality of Y-address lines each coupled to 
the image sensing pixels in a corresponding 
one of the rows; 

a plurality of comparators, each coupled to an 
output of a corresponding one of the columns; 
and 

a latch coupled to the comparators. 

8. The device of Claim 7 further comprising: 

a shift register coupled to the latch. 

9. The device of Claim 7 or Claim 8 further compris- 
ing: a decoder coupled to the Y-address lines. 
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Claims 

1 . An image sensor comprising: 

a light sensing element for providing a signal in 
response to incident light; 
a comparator coupled to the photo sensing ele- 
ment for detecting when the signal reaches a 
reference level; 

a resetting device coupled to the light sensing 
element for resetting the light sensing element 
when the signal reaches the reference level; 
and 

a memory device coupled to the comparator for 
receiving and storing an output from the com- 
parator. 

2. The device of Claim 1 further comprising: 

a multiplex switch coupled to an output of the 
memory device. 

3. The device of Claim 1 or Claim 2, wherein the light 
sensing element comprises a photo transistor. 

4. The device of Claim 1 or Claim 2. wherein the light 55 
sensing element comprises a photo diode. 
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10. A method for sensing light comprising: 

accumulating charge on a light sensing ele- 
ment in response to incident light; 
forming a signal from the accumulated charge; 
comparing the signal to a reference level; 
recording a first level in memory if the signal 
has not reached the reference level; 
recording a second level in memory if the sig- 
nal has reached the reference level; 
resetting the light sensing element if the signal 
has reached the reference level; and 
repeating the above steps V times in a set 
period of time. 
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5. The device of any of Claims 1 to 4, wherein the 
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(54) Improvements in or relating to image sensing devices 



(57) An image sensing device includes: a light sens- 
ing element 20 for providing a signal in response to inci- 
dent light; a comparator 24 coupled to the photo 
sensing element 20 for detecting when the signal 
reaches a reference level V REF ; a resetting device 22 
coupled to the light sensing element 20 for resetting the 



light sensing element 20 when the signal reaches the 
reference level V REF ; and a memory device 26 coupled 
to the comparator 24 for receiving and storing an output 
from the comparator 24. 
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